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ABSTRACT 

This paper develops the techniques for allocating the 
quantity of a school's resources to particular programs and 
classrooms vithin the school, considering the sharing of resources • 
The methodology presented determines the cost of an educational 
program by identifying the resources utilized in a program. All costs 
are taken into consideration and are placed within the framevork of 
staff, equipment, materials, facilities, and services. The paper 
suggests that this methodology is much stronger than the more 
traditional budgetary and cost/pupil approach. (Author) 
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ABSTRACT 



THE RESOURCE APPROACH TO PROGRAM COST ANALYSIS 

DONALD L. FLYNN, PAUL F. DIENEMANN, NABEEL A. AL-SALAM 
RMC Research Corporation 

The methodology of costing an educational program by identifying the 
resources it utilizes is presented. All costs are taken into consideration 
and are placed within the framework of staff, equipment, materials, facili- 
ties, and services. This paper suggests that this methodology is much 
stronger than the more traditional budgetary and cost/pupil approach. The 
paper develops the techniques for allocating the quantity of a school's re- 
sources to particular programs and classrooms within the school, considering 
the sharing of xxsources. 



RESOURCE APPROACH TO PROGRAM COST ANALYSIS 



Donald L. Flynn 
Paul F. Dienemann 
Nabeel A. Al-Salam 

With growing importance being given to evalioating the cost-effectiveness 
of educational programs, it is becoming more critical to develop accurate 
estimates of the true cost of a program. The use of budgetary per pupil 
accounting costs for estimating program expenses is vraefully inadequate for 
an effective analysis. For the most part, school districts' budgets do not 
separate costs for individual classrooms within a school. To use district- 
wide budget costs as an estimate of cost implies that resources are used 
uniformly throughout a school or district. Unfor^tunately, this inqjlicit 
assimiption is usually not correct. Education programs quite often concentrate 
school resources in an effort to assist a small target population. Average 
program costs based on budget data tend to obscure the true cost of these 
concentrated resources. In addition, the use of budgetary cost data neglects 
the value of resources inherited from past years expenditures. Budget costs 
can also distort the evaluation of program costs by including one-tiiae capital 
expenses in the estimate^;. 

A more appropriate technique for estimating the cost of individual pro- 
grams is by determining the actual quantity of all resources (i.e., staff, 
equipment, materials, and facilities) used in a program, and then estimating 
the cost of these resources. We refer to this technique as the resource 
approach to program cost analysis. Because the procedure enumerates the 
resources for each program separately, it allows for a wore precise examin- 
ation of the impact on cost of differential uses and mix of resources. In 
addition, because it considers all resources independent of when they were 
acquired, it allows the examination of inherited resources. 

Several previous studies have examined the resource approach to cost 
analysis, particularly by Haggart."^ However, the approach presented in most 
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previous studies assumes that the identified resources are used exclusively 
by a particular program. In actual practice, exclusive use is rare. Gener- 
ally, resources are shared by a variety of programs. For example, classroom 
teachers generally provide instruction in more than one subject area, and 
equipment is shared by all teachers in a school. While the techniques presented 
in previous studies can be modified to consider this sharing* of resoi:irces, no 
systematic procedures to do this were developed. It is the purpose of 
this paper to re-examine the resource approach to program cost analysis and 
to develop a model to estimate the cost of educational p7:ograms considering 
the use of shared resources. 

The cost model developed in this paper was designed to complement and 
support a large-scale evaluation of compensatory reading programs being con- 
ducted by the Educational Testing Seivice (ETS) for the U.S. Office of Educa- 
tion. The most significant phase of this evaluation involves the examination of 
reading programs in approximately 260 schools around the nation. Of this total, 
approximately 100 schools had con^sensatory reading programs funded by Title I, * 
100 had compensatory reading programs funded from sources other than Title I, 
and 30 had no identified compensatory reading programs. The remaining schools, 
approximately 30, were included becuase they were considered exen5)lary pro- 
grams. In each school, all the students in the second, fourth, and sixth 
grades were given special pre- and post-tests to determine reading achieve- 
ment and changes in student attitudes during the school year. For these 
students, detailed attendance records were kept of their participation in 
particular reading classes. In addition, the principal and all teachers of 
students in the affected grades completed questionnaires where they described 
the demographic characteristics of the students and discussed their techniques 
and approaches to teaching. Finally, the principal coi^pleted a questionnaire 
where he identified and enumerated all the resources en5)loyed in his school. 

Because the collection of these data has just recently been conpleted, 
no results are presently available. Vfhen they become available later, both 
the program costs and obseri^^ed program outcomes will be integrated into a ^ ,.f 
cost effectiveness evaliiation to determine the relative merits of alternative 
compensatory reading programs. Althbu^ "final results cannot be reported in 
this paper, it is felt that the approach taken in the analysis of reading 
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program costs was unique and offered a consistent framework for analysis 
that could be adopted in other program evaluations, 

PRINCIPLES OF COST 

Before discussing the basic model, a number of technical and conceptual 
issues must be confronted regarding cost. These issues include the use of 
total vs incremental costs, the identification of both capital and annual 
operating cost, and the lise of actual vs standard costs. A brief discussion 
of these issues is provided* below. 

Total vs Incremental Cost 

Costs of individual reading programs can be investigated in two distinct 

ways. The first is referred to as total program costs. Included in this 

definition are the total expenditures, both past and present, for all resources 

used in a program. Both capital and annual operating expenses are included. 

Total program costs also include the cost of resources available within a 

district or assets inherited from discontinued programs which can be used in 

the reading program. Sue Haggart of the RAND Corporation refers to this cost 

2 

as the comparable replication cost. Total program cost is the most appro- 
priate format for coii5)aring alternative program costs, and is the format used 
in. this report. 

Incremental program costs, on the other hand, measure only the additional 
costs required by a district to iji?)lement a reading program. Costs for in- 
herited assets or donated resources are disregarded and treated as free goods. 
Economists refer to these as "sunk" costs. Incremental cost is best used in 
deciding whether or not a particular program should be iiT5)lemented in a 
specific district. It is riot appropriate for making comparisons of alternative 
reading programs. 

Capital and Annual Operating Cost 

For all elements of the reading program, costs are separated into two 
categories: capital investment and annual operatirig expenses. Capital costs 
are one-time expenditures needed for the initial implementation of a reading 
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program. These include costs for new facilities, equipment, materials, and 
initial staff training. If a program is totally new (such as a demonstration 
project), the capital costs might also include one-time expenditures for pro- 
gram de5ign and development of materials. For this study, however, we have 
disregarded program development costs. Rather, we have estimated the costs of 
fully operational programs. 

Annual operating expenses are the costs needed each year to operate and 
maintain a reading program according to its initial design. They iMclude the 
expenses for salaries, in-service training, materials and supplies, equipment 
maintenance, facilities operations and maintenance, and other services related 
to the reading program. These two broad categories of cost--capital invest- 
ment and annual operations --are used as the basis for organizing the cost 
elements of school and class level reading programs. 

The primary distinction between the two categories is the length of time 
benefits are derived from each type of expenditure. Capital resources last 
many years, while annual expenditures (by definition) are consumed in less 
than one year. To facilitate making cost-effectiveness comparisons of alter- 
native reading programs, we need to combine the two costs into a single value* 

The best procedure for making the two costs comparable is to convert the 
capital investment costs into a series of uniform annual expenditures. Capital 
costs are "amortized" over their useful life using the following formula: 

Equivalent ^ Capital Capital 
Araiual Cost Cost Recovery Factor 

(CRF) 

Where CRF = i(l+i)"/(l+i)^-l. 

n = useful life 
i - discount rate. 

The anniaalized capital costs computed in this manner can be combined with 
the other annual operating expenses to give total annualized program costs. 

Actual vs Standard Costs 

The final issue involves a choice between using the actual cost of a 
resource at each school, or a "standardized" cost. The actual cost is the 
cost the school actually paid for a resource. Actual costs require the use 
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o£ separate teacher salary schedules for each school district, and specific 
price levels for individual equipment and facility costs. For the same 
resource actual costs will vary from school to school depending on local 
salary levels and economic conditions. Standard costs, on the other hand, 
are based on national averages and eliminate tlie local and regional variations 
in cost.- 

It is important that local administrators know the actual cost of a 
program, particularly with regard to the actual incremental cost of the 
program because this represents the cost to the school district to institute 
a program. However, actual costs tend to obscure the comparison of alter- 
native school reading programs because of the influence of local variation in 
the cost. For this reason, only standardized costs should be xased to compare 
alternative programs. This procedure is used in this paper. It should be 
pointed out, however, that there is no limitation within the model as to the 
type of cost, either actual or standard, which must be used in the model. 

PROGRAM COST MODEL 

The resources used in a reading program are defined by category and in- 
clude staff, facilities, equipment, material, and district centers. For each 
of the resource items within these categories, the reading program cost 
model estimates the quantity that is available for. reading in each school. " 
Using the unit cost factors for each resource item, it then calculates the 
total cost of employing the resource for reading. In this study, unit cost 
- is defined to represent the cost of a single unit of the resource, for example, 
one tape recorder. 

The basic procedure used in the mo^el is presented in Figure i. It 
consists of four submodels and a series of inputs and outputs. Each of these 
submodels and their associated inputs and outputs are discussed below. 

Program Allocation Submodel 

The program allocation siibmodel is used to estimate the quantity of a 
resource that is employed for reading in a school. The model utilizes as 
inputs the total quantity of a resource available in a school and a program 
factor. This program factor represents the proportion of time that the 
resource is used by the school in reading, rather than in other subject areas. 

-..■:/ 
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The procedure for calculating program factors varies according to the type 
of resource being examined. Specific cases are discussed later in detail. 
The product of these two inputs is an estimate of the quantity of resources 
available in a school for reading. In equation form, this submodel can be 
expressed as follows: 

SRR = np (1) 

where SRR « quantity of school reading resources 
n = total quantity of a resource available 

in a school - . 
p = program factor: fraction of tiiiie a 

resource used in reading 

In other wwds, the program allocation submodel divides the resources available 
in a scliool into those used in reading and those that are not. 

Reading Class Allocation Submodel 

For purposes of estimating costs , a reading class is defined as any groiq) 
of students for which a separate attendance record is kept. Reading clashes 
are generally conventional classrooms, but may also include small groups of 
students taught by a reading specialist if attendance was taken. 

The reading class allocation submodel is used to estimate the quantity of 
resources actually employed in each reading class. The submodel utilizes as 
inputs the quantity of school r'^iading resources, determined by the program 
allocation submodel and a reading class factor. The reading class factor is 

the proportion of time that a shared resource is used in each reading class. 

The calculation of this factor varies with different resources and is discussed 
later in detail. The product of these two inputs is an estimate of the quantity 
of resources available in each reading class for reading. Mathematically, 
this submodel can be expressed by the following equation: 

. CRR = npr (2) 

where OIR - quantity of class reading resources 

r - reading class factor: fraction of time 
' a resource is used in a particular 
reading class when the resource is 
being used in reading. 

llius, the reading class allocation submodel divides school reading resources 
among all classes iji the school where reading is taught. Although only the 



resources used in the reading classes in the second, fourth, and sixth grades 
are tabulated by this submodel, all reading classes in the schools are considered 
in the calculations. 

Task Allocation Submodel 

The majority o£ the resources used in a school for reading are used for 
actual instructional purposes. There are other tasks, however, which are neces- 
sary to properly support any reading program. These additional tasks include 
the diagnosis of student reading problems, in-service training for reading 
staff, and program planning and administration. The emphasis given by various 
scliools to each of these tasks may prove important in future cost-effective- 
ness analyses. The task allocation submodel is used to evaluate the relative 
emphasis given to each task. 

The submodel is used to estimate the proportion of each resource employed 
for the four tasks identified above. It utilizes as inputs the quantity of 
school reading resources determined by the program allocation submodel and a 
task factor. The task factor is the fraction of time a resource is used in 
a particular task when the resource is being used in reading. The calculation 
of this factor will be described later in greater detail. The product of 
these two inputs is an estimate of the quantity of resources employed for 
each task. Mathematically, this submodel can be expressed by the following 
equation: 

TRR = npt , (3) 

xvhere TRR - quantity of school reading resoiirce 
by task 

t - task factor: fraction of time a resource 
is used for a particular task vAien the 
resource is being used in reading 

ThuS; the task allocation submodel apportions all school reading resources 
among the various tasks that the school performs. 

Costing Submodel 

The costing submodel performs the final operation of the reading program 
cost mK)del» It is used to calculate the capital and annual operating costs 
associated with the quantity of resources resulting from the other three sub- 
models. In addition, this submodel produces the output reports presented in 
this paper. 



The costing submodel employs unit cost inputs for each resource and 
calculates the cost of the various school, class, and task resources used 
in reading programs. As defined previously, a unit cost is the cost for one 
unit of a resource. Unit costs include the capital cost con?)onent (i^e,, 
the non-recurring cost to acquire the resource) and operating cost con^nents 
(i.e,, the annual recurring cost), i 

The costing siabmodel operates by multiplying the unit cost for each 
resource item by the quantity used for the various levels of the analysis. 
Mathematically, this submodel can be expressed by the following three 
equations: 

SRC « npc (4) 
CRC = nprc (5) 
TRC « nptc (6) 

where SRC = cost of a school reading resource 
CRC = cost of a reading class resource 
TRC cost of a school reading resource 
by task 
c - unit cost factor 

Model Operation 

. A total of 94 different kinds of resources were identified. For each 
of the resource items, the following parameters must be calculated to operate 
the reading program cost model: 

• school quantity (n), 
0 program factor (p), 

t reading class factors (r) , , . 

• task factors (t), and 
f unit cost (c). 

Using \these parameters as inputs , the model is operated in successive steps 
to derive estimates of the quantity and costs of each reading program resource 
at the various levels of analysis shown on Figure 1. The results of these 
successive operations are aggregated to form total school, reading class, and 
task costs. 



DATA COLLECTION 

The analysis of reading program costs involved data from four primary- 
sources: 

1. Resource Questionnaire 

2. Site Visit Reports , 

3. Program data 

4. Secondary data sources. 

The Resource Questionnaire was mailed to the principals in all schools in 
the sample. The instrument was designed to collect specific information about 
the number and t)'pe of resource at each school and how each is used in reading 
instruction. It addresses only those areas related to resource requirements, 
i.e., number of staff, type of staffs equipment inventory, materials used, etc. 
It did not solicit any information about costs. A response rate of about 
97 percent was obtained from the Resource Questionnaire. 

Actual site visits were made to a sample of 100 schools for the purpose 
of collecting detailed cost and program data relevant to the school reading 
programs. Tne cost data collected from these schools were used to derive 
standard cost factors for computing program costs for all 260 schools. Costs 
were .collected for direct resource items and for all indirect activities and 
district services that support school reading programs. 

Both the Program Characteristics Questionnaire and the Teacher Character- 
istics Questionnaire sent to all teachers involved in the study were used as the 
primary data sources for estimating class level costs. Specific data utilized 
from these questionnaires included information about the amount of time spent 
jji reading, tlie use of specific equipment, and the teachers* experience and 
academic degrees. In addition to these questionnaires, student attendance 
records kept by these teachers were losed in identifying the reading specialists 
in the school. 

The final source of cost data was from secondary sources including 
reports, price catalogues, and national publications. These were particularly 
useful in preparing the detailed cost estimates for specialized staff personnel, 
equipment, and reading materials. 



CALCUIATION OF MODEL PARAMETERS' 

Using the data collected from the four sources above, the five model 
parameters can be calculated for each resource. Two of the^e calculations are 
relatively straightforward. The school quantity (n) is determined directly 
from the Resource Questionnaire. The unit cost of a resource (c) is standard- 
ized for all schools and set equal to the average value of the observed cost 
for each resource seen at the 100 site visits. The remaining three parameters 
are more difficult to explain becaus^ they vary with various categories of 
resources depending on how their use ? is divided between different subjects and 
different classrooms. These three factors are discussed below for various types 
of resources. 

Program Factors 

As defined previously, the program factor represents the proportion of the 
cost of a resource that must be allocated to the reading program. The procedure 
for estimating this factor for the five general types of resources is presented 
below. 

Staff 

There are five general categories of staff for which different 
rules for calculating the program factor have been identified. These 
include the regular classroom teachers, teacher aides and other pro- 
fessional staff, general administrative personnel, and reading adminis- 
trative personnel. Each of these is discussed below. 

• Regular Classroom Teachers 

Regular classroom teachers teach a variety of subjects during 
the day. By our definition, the program factor is proportional to 
V the amount of time they spend teaching their students reading. 
- The total amount of tijne they spend in reading each week can be 
determined from the Program Characteristics Questionnaire they 
completed. If this number is divided by the total amoimt of time 
they spend in class each week (estimated to be 30 hours) , their 
program factor can be calculated. Mathematically: ' 

P 30 (7) 

where h = hours spent in reading per week 
as determined from Program 
Characteristics Questionnaire 



Teacher Aides or Other Professional Staff 



In the Resource Questionnaire^ the principal was asked to 
estimate the percentage of time that this type of staff spent in 
non- reading activities. By siibtracting this percentage from one, 
an estimate can be made of the time spent in reading, which is 
used as the program factor. Mathematically, this relationship can 
be expressed by the following equation: 

p = 1-k (8) 

where k = fraction of time a staff member spends 
in non- reading activities 

General Administrative Personnel ; 

Certain staff in the school provide support to the general 
operation of the school, although not directly to the reading 
program. These, staff include the principal and the secretaries . 
It is assumed that the program factor for these staff is equal to 
the average value of the program factor for all classroom teachers. 
This is based on the fact that these staff, while not necessarily 
involved in tlae reading program, are required to operate the school 
and do support the teachers. It is reasonable to assume that 
their indirect support of the reading program is proportional to the 
amount of time the average teacher spends in reading. This program 
factor is calculated by the following equation: 

th 

where p- = the program factor for the i classroom 
teacher 

N = total number of classroom teachers in analysis 

Reading Administrative Personnel 

Certain administrative staff are fully dedicated to the reading 
program. These staff, usually found at the district level, include 
the. reading supervisor and special teaching consultants. Thus, 

p = 1.00 (10) 

Facilities 



The classroom is used as the basic resource unit in the facilities 
cost model. It is reasonable to assume that the use of facilities for 
reading purposes is proportional to the amount of time the class 
instructor teaches reading. Thus, knowing the type of class instructor 
either a regular classroom teacher or a reading specialist, the 
program factor can be calculated by either Equation 7 or 8. 



Equipment 

For each type of equipment available in the school, the principal 
was asked to indicate how often it ivas used for reading instruction as 
oppdsed to other subject areas. These responses were used to estimate 
the program factors for equipment* 

Materials 

Four types of materials are investigated in the reading program 
cost model. They include: basal readers, individual reading kits, library 
books, and other siq)plies. The program factor for basal readers, individual 
reading kits, and library books, because they are used almost exclusively 
for reading, is assumed to be eqxial to one. Because the other supplies 
include the expenditures for all subjects, this same assumption cannot 
be made. However, it is reasonable to assiime that the allocation of such 
supplies to reading programs would be proportional to the amount of time 
spent in reading* Thus, the. average, teacher program factor (see Equation 9) 
is used to estimate the qtiantity of otl)er supplies used for reading 
. programs. 

District Centers 

There are two kinds of district centers: those which specialize in 
dealing with students thanselves and those that act as resources to schools. 
The first type generally provides a variety of instructional or diagnostic 
services to which the schools can send students. The second type does not ' 
deal directly with students, but acts as a resource to the schools by 
providing additional equipment and materials, giving staff training 
sessions, developing curriculum, etc. For costing purposes, these types 
are called Student Related Centers and Resource Related Centers, respec- 
tively. Because of the relatively smkll number of these centers and the 
significant variation in their character between schools, it was decided 
that the cost of these centers to a school to support their reading pro- 
gram would be calculated outside the reading program cost model. Because 
the cost thus calculated does not include the non- reading functions of 
these centers, the program factor is defined as one* 
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Reading Class Factor 

As previously defined, the reading class factor represents the proportion 
of the cost of a reading related resource that must be allocated to a partic- 
ular classroom. The procedure for estimating this factor for the five general 
types of resources is presented below. 

Staff 

There are four general categories of staff for which different rules 
for calculating the reading class factor have been identified. These 
include the regular classroom teachers, a reading specialist who identified 
her students, support staff whose assistance to individual teachers was 
discussed in the Program Characteristics Questionnaire, and other staff. 
Each of these is discussed below. 

• Regular Classroom Teachers 

Classroom teachers only teach reading to one class. Thus, 
because their time when they are teaching reading is fully dedicated 
to one class, their reading class factor is equal to one, or: 

r = 1.0 (11) 

• Reading Specialists 

When a reading specialist identified the students she taught 
by keeping study attendance records, a reading class similar to 
that of a regular classroom teacher was formed. It is possible to 
allocate the cost of this reaiding specialist directly to this class. 
In the event she does not keep such attendance records, this identi- 
fication is not possible^, and her cost must be allocated using 
different rules discussed in later sections. 

Becaiise of the large number of students a reading specialist 
works with, and the likelihood of teaching students in more than 
one grade, a reading specialist who does keep study attendance 
records generally is associated with more than one reading class 
record. It is assumed in this model that the fraction of time she 
spends with each class is in proportion to the nmber of students 
in that class divided by the total number of students being taught. 
Since the specialist teaches only reading, this same proportion is 
equal to the reading class factor. From the attendance records, 
it is possible to determine the nxanber of students that are taught 
in the second, fourth, and sixth grades. Unfortunately, attendance 
was not taken for students in the first, third, and fifth grades. 
Thus, the number of students an instructor teaches in these grades 
is not knoim, nor is the number of students she teaches known. 
. However, an? estimate can be made of the total number of. students 
taught by determining the average number of students taught per 



grade for the grades where attendance is taken. This average, 
nailtiplied by the number of grades in which the instructor is 
known to teach (available in the Resource Questionnaire) forms 
an estimate of the total number of students taught • Expressed 
in equation form, this becomes 



St = f • f (12) 

where s. = total number of students taught by an 
^ instructor 

s - total number of students known to be . 
taught by this instructor in Grades 
2, 4, and 6 

e = number of Grades taught by instructor ; 

in grades 2, 4, and 6 
f = total number of grades taught by 

instructor 

This calculation is best danonstrated with an example. Suppose a 
particular reading specialist teaches 10 students in the second 
grade and 14 students in fourth grade (s = 10 + 14 = 24). Considering 
only Grades 2, 4 , and 6, she teaches two grades (Grades 2 and 4, 
or e = 2). If, from the Resource Questionnaire, she is known to 
actually teach Grades 2, 3, and 4 (f = 3) , an estimate of the total 
number of students she teaches is (24/2) • 3 « 36. Using this result, 
the reading class factor for a particular class taught by this 
instructor can be calculated by the following e(iuation: 

where s = nuniber of students in class 

s- = total ntmiber of students taught by instructor 



Si5)port Staff 

In the reading class allocation submodel, certain types of support 
staff are allocated to reading classes in proportion to how often the 
teachers indicate they use these staff. For example, a teacher who 
indicates that she uses a teacher aide on the average of two hours 
a week for reading, would be assigned 2.7 percent of the total scliool 
reading program ase of teacher aides, if the total estimated usage 
of teacher aides in the reading program was 75 hours per week (2/75 = 
.027). This technique for deteraiining reading class allocations is 
called the Class Measure of Use Factor. 

IVliile con^)leting the Program Characteristics Questionnaire, 
teachers were asked to estimate their frequency of use of particular 
types of support staff. They were asked to indicate whether these 



staff were used often, sometimes, rarely, or if they were not 
available. Interpreting the meaning of these responses is some- 
what arbitrary. However, based on discussions with principals and 
teachers during our site visits, a range of use was developed 
and is presented in Table 1. Based on these ranges, specific 
estimates, called measure of use, were made for each response. 
As can be seen later, the model is sensitive only to the relative 
magnitudes of these estimates, and not to the absolute values. 

The measure of use? factor for each class is calculated as the 
ratio of the estimated ^use indicated by the teacher divided by 
the total amount of use for all teachers. Before this calculation 
can be made, however, two considerations must be examined. First, 
the use of fixed estimates for all instructors assumes that all 
instructors teach reading the same amount of time. This is not true, 
of course, considering the distinction between regular classroom 
teachers and reading specialists. Second, the total estimate must 
take into consideration the use of resources by all other teachers 
in the school who did not complete questionnaires. These consid- 
erations are discussed below. 

A regular classroom teacher teaches a variety of subjects 
including reading. Generally, reading is taught for only approxi- 
mately one ]iour a day by such a teacher. On the other hand, a 
reading specialist may spend up to five or more hours a day teaching 
reading. It is obvious that if both types of instructors claim 
to use *'often'' a particular type of support staff, the reading 
specialist is likely to actually use staff far more than the regular 
classroom teacher. For purposes of this study, it is assumed that 
relative use of staff between types of instructors will vary in pro- 
portion to the3.r approximate hours of reading instruction. Thus, 
if both instructors indicate the same use in the questionnaire, a 
reading specialist will be assumed to actually use staff five times 
more often than a regular classroom teacher. As an example, suppose 
that a reading specialist and a regular classroom teacher each 
indicated that they used aides often. It is then assumed that the 
reading specialist uses aides a total of 50 hours per month, while 
the regular classroom teacher will use them only 10 hours per month. 
This procedure is called 'Weighted measure of use," and is presented 
mathematically below. 

= a • w 

wliere v;' = weighted measure of use 
w = measure of use 
a = weighting factor 

and a =1 for regular classroom teachers 

a = 5 for reading specialists 

The reading specialists may teach several classes, and their use 
of staff should be spread across these classes. It is assumed that 



Table 1 

ESTIMATE OF RESOURCE USE 



i 



Teacher Response 


Range of Use 


Measure of Use 1 
Factor j 


Often 


1 hr/week 
to 1 hr/day 


10 hrs /month 


Sometimes 


1 hr/month 
to 2 hrs/week 


5 hr^/month 


Rarely 


less than 
2 hra/month 


1 hr/month 
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the use o£ staff by reading specialists is proportional to the 
nmber of students in the class. The following corrected measure 
of use is defined for each class: 



(15) 



where v; = estimated use in one class 
s number of students in class 
s- = total number of students taught 
(see Equation 2-10) 

For regular classroom teachers, the corrected measure of use is 
equal to the total estimate use because they do not teach more than 
one class. Thus: 



w = w' 



(16) 



When estimating the total reading program use of staff, 
one cannot simply sum all i^^^, since these exclude all teachers 
who did not complete questionnaires. However, it is reasonable that 
the average usage indicated by the teachers viho did con5)lete the 
questionnaire is representative of all teachers in the school. 
Thus, an estimate of total reading program usage can be obtained 
by determining an average teacher measure of use and multiplying 
it by the number of teachers in tlie school. This process is demon- 
strated below. 



First 
where 



then 
where 



z = ^ 
x+y 

z - average teacher use of a resource 
X = number of regular classroom teachers 

completing questionnaires 
y = number of reading specialists com- 
pleting questionnaires 



(17) 



t 



(18) 



w^ = 



X^ = 



estimate total reading program use 
of a resource 

total number of regular classroom 
teachers in school 

total number of reading specialists 
in school. 
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Using Equations 14 through 18, it is possible to calculate the 
class measure of use factor, as demonstrated below, 

T't ■ C19) 

t 

Other Staff 

For those staff whose use in the classioom is not discussed 
in the Program Characteristics Questionnaire, it is assumed that 
their cost is allocated uniformly to all students in either the 
grades for which they are available, if they are support staff, or 
for the entire school, if they are basically administrative or 
clerical personnel. The calculation of the reading class factors 
for each class is calculated as the ratio of the number of students 
in a particular class divided by the total number of students who 
utilize the staff. In equation form, this factor is confuted as 
follows: 



s 

r = 

s 



^ 1 (20) 



vfliere s = number of students in a particular class 

s = total number of eligible students deter- 
mined from Resource Questionnaire. 

Facilities ^ 

Because the use of facilities for reading-is assumed to be propor- 
tional to the amount of time the class instructor spends in the class 
for reading, the reading class factor used in the class allocation sub- 
model is identical to that used for the class instructor. I&iowing the 
type of class instructor, either a regular classroom teacher or a reading 
specialist, the reading class factor can be calculated by either Equation 
11 or Equation 13. 

Equipment 

In the Program Characteristics Questionnaire, each class instructor 
indicated the frequency with which she used general categories of equip- 
ment. Using the measure of use class factor procedure developed in 
Equation 19, the individual reading class factors can be calculated. 



Materials 

The use of basal readers and individual reading kits is discussed 
by each teacher in the Program Characteristics Questionnaire. Therefore, 
the class factors for these t\\ro resources are calculated using the measure 
of use class factor procedure developed in Equation 19. 

The other two resources, library books and other supplies, are not 
discussed in the questionnaire. Because there is no reason to believe 
that a particular reading class will use more of these resources than 
another, these resources are allocated to all classes in the school using 
the uniform class factor procedure (see Equation 20). 

District Centers 

Because no information is available to indicate which reading classes 
make use of the district centers, the costs of the centers are allocated 
to all classes in the school using the uniform class factor procedure 
(see Equation 20). 

Task Factors 

As defined previously, the task factor represents the proportion of the 
cost of a reading resource that is used to accomplish a particular task within 
the school. These tasks include instruction, diagnosis of student problems, 
in-service training for reading staff, and program planning and administration. 
The estimates of these factors presented in this section are based on discussions 
vdth principals and teachers during our site visits. Although the values are 
somev\'hat arbitrary, the use of these factors gives additional insight into the 
relative emphasis schools attach to each reading task. Sensitivity analyses 
could be performed where the impact of varying these task factors on the final 
cost estimates could be exainined. As before, these factors are presented 
below by type of resource. 

Staff 

This section describes the factors used to allocate staff costs to 
program tasks- -instruction, diagnosis, training, and administration. The 
kinds of staff used in this analysis were originally identified along 



functional or task lines. Thus, it is assumed that for a particular kind 
of staff, the amount of their time spent performing a task will not 
generally vary significantly between schools. 

The task factors, listed in Table 2, represent an estimate of the 
fraction of the total reading time that each of the 39 types of staff 
spent performing each of four tasks. The staff training task shown in 
this table represents the amount of time an individual spends training 
other staff. It does not include time spent receiving training. The 
amount of training received is in5)ortant and an alternative procedure has 
been developed. From the Resource Questionnaire, an estimate is made of 
the average number of hours per year that teachers receive in-service 
training for reading instruction and diagnosis of reading problems. 
. Dividing these hours by the total number of Hours a teacher teaches in \ 
a year (6 x 180 = 1,080), an estimate is made, of the fraction of time 
teachers spend receiving training. This fraction, b, is added to the 
training task. Obviously, the sum of these task factors must not exceed 
one. The procedure for correcting this problem is shown below. 

For Instruction, Diagnosis, and Administration Tasks 

f - t (1-b) 

For Training Task 

t» = t (1-b) + b 

where t' = corrected task factor 

t = task factor from Table 2 
b = fraction of time an average teacher 
spends receiving training 

Facilities 

The use of facilities for perfoming the various reading program 
tasks depends on the coii?)Osition of the staff in the school . It is diffi- 
cult, therefore, to estimate the average use of facilities by program tasks. 
However, after a review of the average composition of staff in all schools, 
the following estimates were made of the task factors : 

o 
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Table 2 



STAFF TASK FACTOR 



"■' 

staff Mombors 


Instruction 
Factor 


Diagnosis 
Factor 


Training 
Factor-*- 


Administration 
Factor 


1 Classroom Teacher 


.70 


• 15 


• 00 1 


• 15 




• 1 1/ 


• AD 


nn 


• JLu 


Para professional • ' 


• 85 


• 05 


• 00 


• 10 


i Teacher Aide 


• 80 


• 05 


• 00 


• 15 


. Tutor 


• 90 


• 05 


• 00 


.05 


! Siudo!it Tcndier 


• 75 


• 05 


• 00 


• 20 


Volur.teor Aides 


• 90 


• 00 


• 00 


• 10 


i Coinpuf cr Proctors 


• 90 


• 00 


• 00 


.10 


Headui;.; Teadier-Instructioual 


• 65 


• 15 


• 05 


• 15 


Heading Teacher- Diagnostic 


• 15 


• 65 


• 05 


• 15 


' Ivca(Hn[»; Toacher- Instructional and 










Diaj;nostic 


• 40 


• 40 


• 05 


• 15 


Reading T on chcr- Diagnostic and Training 


• 15 


• 35 


• 35 


• 15 


Reading Teacher- Instructional, Diagnostic 










! and Training 


• 29 


• ^28 


• 28 


• 15 


Snocial Education Teacher 


• 50 


• 25 


• 10 


• 15 


; Social Si-udics Tenclier 


• 80 


• 05 


• 00 


• 15 


Mali) Te:»clicr 


• 80 


• 05 


• 00 


• 15 


: 'Jcicnco Tcachsr 


• 80 


• 05 


• 00 


• 15 


Ba^:;c ii:l:i!is Teacher 


• 70 


• 15 


.00 


.15 


Olhor Sjxrjialty Teacher 


.80 


• 05 


• 00 


.15 


: LiLrurian 


• 


AA 
• 00 


• UD 


• «U 


Learning Disabilities Teachers 


• 50 


.25 


• 10 


• 15 


Psycliologist 


• 00 


• 90 


• 05 


• 05 


Speech, Hoariiig, Visual Specialist 


• 00 


• 90 


• 05 


• 05 


Diagnostician 


• 00 


• 90 


• 05 


• 05 


• Media Spi.'cialist 


• 00 


• 00 


• 60 


.40 


Consultant 


• 00 


• 00 


1^ 00 


• 00 


I Doctor 


• 00 * 


• 90 


• 05 


• 05 


' Nurse 


.30 


:5o 


• 05 


• 15 


^ Social Counselor 


.00 


• 30 


• 30 


• 40 


1 Librarj' Aide 


• 00 


• 00 


• 00 


1^00 


S Non-Inst ruction Aide 


• 00 


• 00 


• 00 


1^00 


1 Clerical Aide 


• 00 


• 00 


• 00 


1^00 


1 Secretary 


• 00 . 


• 00 


• 00 


1^00 


1 Suporintfindent 


• 00 


4 00 


• 10 


• 90^ 


1 Director (Assistant, Superintendent, 










I Administrator) 


• 00 


• 00 


.15 


.85 


1 Supervisor 


• 05 


• 10 


• 15 • 


r ^70 


j Teacher Consultant 


.15 


• 35 


.35 


' .15 


J Federal Projects Director 


.00 


• 00 


• 10 


• 90 


1 Principal 


.05 


• 10 


.10 


.75 



Note: The training factor includes only the training of others^ It docs not include the time 
spent receiving trainings The corrections for including this are discussed in text^ 
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Instruction Task Factor « .63 

Diagnosis Task Factor « .10 

Training Task Factor « ,10 

Administration Task Factor = .IS 



Equipment • 

Equipment is generally used for instruction, ftowever, reading machines 
and computers do provide some capability for diagnosing student problems. 
This capability usually is available because of the use of curricula in 
conjunction with these machines. Computers , because of their high speed 
capability, often actually prepare diagnostic studies of students by . 
examining their mistakes. For this reason, 10 percent of the cost of 
reading machines and 20 percent of the cost of computers are assigned to 
the diagnostic task. The balance for each is assigned to the instruction 
task. For all other types of equipment, the complete cost is assigned to 
the instruction task. 

Material 

Because of the curricula embedded within basal readers and individual 
.reading kits, some diagnostic capability is available. For this reason, 
10 percent of the cost of basal readers and 20 percent of the cost of 
individual reading kits are assigned to the diagnostic task. The balance 
for each is assigned to the instruction task. The cost of library books 
and other supplies will be assigned completely to the instruction task. 

District Centers 

The following estimates represent the assumed use of the two types 
of district centers observed in the study. 



Task Student Related Resource Related 

Factor Center Center 



Instruction .40 .40 

Diagnosis .40 .10 

Training .10 .40 

Administration .10 .10 
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UNIT COSTS 

Fbr each o£ the 94 different kinds of resources identified in the model, 
a unit cost was calculated based on the data gathered during the site visits. 
In addition, teacher salaries were defined for various years of experience and 
educational background to allow the differentiation of these factors in cost* 
The calculation of all unit costs included both the annual or recurring cost of 
a resource and a portion of the capital or original cost of a resource amortized 
over the life of the resource. The unit costs thus calculated represent the 
effective annual cost to a school to utilize this resource. As discussed before, * 
these costs can either be the actual costs for resources -to a particular school 
or a standard cost representing all schools. IVhen actual costs are used, the 
resulting program cost estimates are meaningful to local school administrators 
because this is the cost they are paying for the program. Because of local 
variations however, this estimate obscures a meaningful comparison betw^een schools. 
When such conparisons are to be made, standard costs should be uised. 

The basic methodology for developing the unit cost estimates is presented 
below as it pertains to (1) staff, (2) equipment, (3) materials, (4) facilities, 
and (5) district services. 

Staff Costs 

Since staffing costs are a major portion of cost of any education program, 
considerable attention was given to this cost category. Unit costs (i.e., annual 
salary plus fringe benefits) were determined for 39 differen 
ihg: classroom teachers, reading teachers, teacher aides, psychologists, nujrses, 
secretaries , and district superintendents . 

District salary schedules were the primary data source for deriving staff 
costs. At the site visits, actual teadier salary schedules were collected for 
97 school districts. The schedules were all structured on the basis of teaching 
experience and educational background. A composite teacher salary schedule was 
developed from the site visit data as shown in Table 3. 

The indirect salary or "fringe'* benefits was added to the base salaries to 
yield the final unit costs for classroom teachers. These indirect costs were 
estimated as a percent of the base salary. The costs for classroom teachers were 
estimated from the standardized schedule using the actual experience and education 
background of the teachers in the sanple schools. 



Table 3 

AVERAGE CLASSROOM TEACHER BASE SALARY SCHEDULE 





No Degree 


RA 


MA 


PhD 


Base salary 


6,192 


7,294 


8,110 


8,581 


Size of annual increnient 


228 


350 


391 


384 


Maximum number of annual increments 


10 


12 


13 


13 



The salaries and costs for other program staff were coiH)uted using the 
"teacher schedule and average experience and degree levels. For instance, the 
salaries of support teachers such as music, special education, and reading 
specialists were confuted losing the classroom teacher salary formula and the 
average experience and degree levels generally associated with these staff. 
In cases where general qualification levels were not known with sufficient 
certaojity, the actual salaries paid were con5)ared to the average teacher salary 
in the sample schools. Thus, an index was obtained between the staff category 
and the average teacher salary. The index for psychologists, for instance, was 
estimated to be 1.43 times the average teacher salary. The indices were verified 
against other national data sources for education profession salary levels. 

Equipment 

The equipment types for whidv unit costs are calculated are all instructional 
in purpose, and most are of the audio -visual type. The costs of 46 types of 
equipment were estimated. 

To estimate the capital unit cost of an equipment item, a number of consi- 
derations must be taken into account. First of all, within each type of equipn^ent 
•there are visually numerous brands. From the site visit data, the normal mix of 
brands for tape recorders, for instance, was examined. Thus a standardized 
capital cost for each of tlie equipment types was determined taking into account 
the proportion of low- and high-priced machines a school normally purhcases. 
In addition, all purchase prices reported by schools were converted into 1973 
dollars to eliminate the effect of inflation on the data. The consumer goods 
price index for durables was used to do this. The capital unit cost of equipment 



was then amortized over the life o£ the machine at a 7% annual interest rate to 
give the annualized capital cost. The life of the equipment was estimated to be 
either 5, 10, or 15 years, depending on the com[>lexity and ruggedness of the machine. 
To the annualized capital costs of the equipment were added two annually recurring 
costs to give the total unit cost of these items. These costs are the annual cost 
for support materials (software), and the annual cost for maintenance. 

Materials 

The items in this cost category include textbooks (basal readers), library 
books, reading kits, and instructional supplies. The unit costs of textbooks 
and library books were estimated on a per book basis, since numbers of volumes 
of these items are usually readily available in schools. However, the unit cost 
of instructional supplies was estimated on an average annual cost per student 
enrolled. This departure was deemed justifiable due to tlie great nmiber of small 
cost elements making up this cost item. The magnitude of these costs does not 
justify the time involved to utilize the resource approach. Lastly, the unit 
cost of reading kits was estimated on a per student basis --not per student enrolled 
but the total unit cost of the reading kit divided by tlio number of students it 
was designed to serve, 

Reading kits were originally kept separate from basal texts, because it was 
expected that they would have a substantially higher per student cost. However, 
the results proved the opposite, because the majority of schools purchased these 
kits as supplementary instructional tools instead of the primary instructional i 
source materials in their curriculum. Due to the vast variety of kits available, 
data were collected on the number of kits the school liad available to it as well 
as the number of students each kit was designed to serve- -hence the approach of 
confuting the \mit cost of reading kits per student served. 

Facilities 

The unit of facility space which was costed was the classroom. The capital 
cost of construction for school facilities was estimated to be in the range of 
$29 to $35 per square foot. Using the estimate of 50 years for the life of a 
school building and an interest rate of 7%, the annualized cost per square foot 
was estimated. From this data collected at tlie site visits, the annual maintenance 
and operating costs were found to be related to total square feet of facility 



space • Ihese costs were estimated at $2.00 per square foot. For estimating-J^ie \ 
capital aiicl annual O^M costs, the size o£ an average classroom including associ- 
ated hall and support office space was assumed to be 1,740 square feet. 

District Services 

Although district services are regarded as a separate cost category, they 
conprise all the categories discussed previously- -staff, equipment, materials, 
and facilities, llius, determining the unit cost of district services is a mini- 
exercise of the methodology already disciassed. District services are divided 
into tu'o primary categories: student centers and resource centers. The first 
is more staff intensive; the second is more equipment, materials, and facility 
intensive. Student centers provide instructional services directly to students. 
ITiese services involve) staff time. Resource centers provide instructional services 
directly to teachers. These services involve equipment and materials. Ifowever, 
tliere ai^e exceptions where the seivices of a resource center involve staff time. 
An example of this is a center providing in-service training or guidance in cur- 
riculum development. This type of center becomes a minor third category of 
district services. 

In a sample of the scliools participating in the study, the cost of these 
centers wa:; studied in detail. Not only were the total cost and "per school 
served" cost computed, but also the ratio of total costs to staff costs. For 
student centers this ratio averaged 1.50, for resource centers, 1.90. Since staff 
data for district sei^vices were collected from all schools in the sanple, total 
costs v/ero estimated using the confuted ratios. Because facility costs turned 
out to be an important part of the total cost of district services, the ratio of 
total CO sis to staff cost for resource and student centers was closer than expected. 

SAMPLE bWEL OUTPUrS 

To serve as a demonstration of the potential use of this model, sanple 
output? are presented for two schools. The outputs employ trial data which 
are not indicative of any particular school. However, they are representative 
of the type and magnitude of output possible. This output is presented in 
Tables 4 through 7. 



For each school, t^vo output formats are used. Because o£ the large 
number of resources considered in the model, tlie resources have been aggregated 
into a total of 19 subgroups and 6 major groups. These are shown on each 
form, and should be self-explanatory. Uie firsl fonnat presents an estimate 
of the total school reading program cost, while tlie second format presents the 
reading program costs for individual classes wj.thin the school. Each format is 
described separately below. 

The first column of the first fonnat present.s the total quantity of a 
resource available in the school (n) . ITie seco?id column presents the output 
of the Progran) Allocation Submodel, which is the total qujtntity of a resource 
used in reading (np) . The next three columns estimate the cost to a school for 
each of the reading resources by the various cost categories (npc). The sixth 
column computes the percentage of the total cost that each subgroup of resources 
represents. The remaining four columns presenr. the annualized cost of each 
resource subgroup divided between the different: education tasks (nptc). 

For eacli class in tlie school included in tlio study, the second format 
presents the per pupil cost for each subgroup o (: resources (nprc) . Differences 
in these costs between classes indicate differcatial use of resources between 
classes. Combined with tho measure of effectiva-ness, these differences will 
provide the basis for future cost effectiveness analyses. 

It should be remembered that there are two different types of classes 
used in the study: regular classroomi^ and classes taught by reading specialists. 
These differences are identified in the second fonnat. A regular classroom 
is identified as a Type 1 class, while a reading specialist's class is a Type 4 
(see School B). In addition, each class can crltJjer be part of the basis 
reading program, or part of a compensatory reDdinjj program. Tliis distinction is 
also shown. 



ERLC 

5^ 



BEST COPY 



AVAILABLE 



CO 
X 
4 

a 

O (A 

o 

a (n 
a c 
U 

o 

c or 

iij C 

a. 

> 

c 2r 

<l o 
< 
2r uj 
u> q: 

o o 
uo 

u u 
o cn 

>- 



ST 


f*" fVi' ^ O ff« 






C o c 


o 


o 


o o e c? 




(KJ 


! 


o c o «o ru 




n 


o o o 


G 




c o o o 






1 s 


• ••••• 


• 


• 


• • • 


• 


• 


• • • • 


• 


« • 


1 c 


(T iv; X a o 


















1 <« 


n »-t tr a *£ t*i 
i-i ^ IT. ^ tr 0* 


C 












• 




1 


cc 














rvj 




%C ^ 




n 












oc 










































u. a. 


tc ct> *o 






o o e 


O 


o 


o o o o 


o 


in ^ 


u o 


«— • »^ CO CO 0^ 




in 


o o o 


o 


o 


o o o o 


o 




>- < J 




















tt K UJ 


• CO ^ «c 


>c 


in 














v> > 


n o o «o 
















e 


1- u. 


— If* (V IV 
















in 


tn a 





















c 



< 

or 

CL 



<3 



c 



a' < 



UJ 

a > 
< e 



I o -J 

I 2r < 

J c o 
>- < 

^ LU 



< -J -J 

0 o ^ 

C? CJ 

1 X o 

I en 
I 







0» IT IT. O O 






coco 


o 


%c in o o 






c 


cr. 


o a IT o m 


tn 


in 


O c o 


■-4 


o in o o 




CD <C 


\u 


c 


















t< 


2 


a* r\2 r". in ao 


cr 


tn 




n 




cr 




»-< 




r; • (V >o tD 




r*- 










>C (M 




< 


fvjin CM 


tn 


ru 










cr 


< 




^ — • cvj n 




rvj 










in 




cs 


















"Z 
























K X IP o o in 


in 


r> 


^ CM «-t 


n 


>o cr in (V 


CM 


fo 


< 




o cr ^ o o ^ 


m 


o 


tn cr ^ o 




in r-« GO cr 


in 


CO n 




z> 




















a 


^ c^ 






#-4 N ^ 


o 


WD r) m 




O XX 






-J- c\j in oj 


u> 




in CM ^ 04 




tn cr ^ 


>o 


00 <Q 




in 


O «-H 






CM CM •I 


«o 


>o tn r<- 


o 








cc %cj 












CV' 


cr 




»«• 


IV; 














tn 






CO vc rvj o o >o 




w 


n o ro 




h- ^ GO 


cu 


o 




C < 






















a* in ^ rvj 


n 


n 








CM 


o 




















.o 























1 tv»«- 


O O O O CC ^ 


cr 


CM 


(M 0» 


m 


CM <f in fv 






1 »-* to 


«<• c o o ^ ^• 


in 


-a- 


r) o >c o 


o' 


c cc cr 






_J c 


• ••••• 


• 


• 


« a • • 




• • • tt 


• 


• • 


in «J o 


^ c vc tn CM 


cr 


in 


^ xM ^ f*. 




o rM n n 




o ^ 


o r? 


*c in <t \o cr 


cc 


IT 


tn P7 *c <v 




o a- cr *T 


in 


r- n 




o cr tr in in 


IT 




rvi iM 


o 


in r- 






2. 


^ CM 


fM 


c^ 






CM 


CO 






r- 


CM 










<r 



O C O C. CD 


cr 


oc 


1^ IM CM O 




o r*) e cv 


in 


cn 


c o e ^ 






\D O ^ v£,' 


r- 


c cr o cr 


a 


cr IT 




■ 


• 


• • • • 


• 


• • • • 


• 


• • 


o *c in CM ^ 


cr 


CM 


^ ^ O CM 




ofo in cn 


CM 


^o cr 


*c in <f vc CT- 


cc 


n 


in »~i t** in 


cr 


o ro cc 4" 




o 


o <t cr cr in IT 


in 








r\ CM 


<n 


o 


^ CM 


(M 


tn 










o 
















cc- 


c o o o c c 


o 


n 


CM a oc ^• 


in 


o o 




cr 


c o o o o o 


o 




CM ^ fO 


CM 


o oc in c 


n 




• • • • • 


• 


• 


• • • • 


• 


• • • • 


■ 


• • 






o 


cr o .n n 




(M rvj 


<r 


00 CM 






c 


^ O CM 




CM4 ^ - 




CM »-» 






in 


^ ^ 30 in 


cr 


o n 00 




<£? #»> 






o 






n CM 


nO 


00 






CM 










CM 






CM 










CM 


in ^ r- ^ 




CM 


o in o o 


in 


o o o* 






X ro *^ 




O 


c c 


CM 


o o o 






• ••••• 


• 


• 


• • ■ ■ 


■ 


■ .• « 












>0 CM 




o r*- o 
















o *^ m . 
















SC f-H fw 






o in o in o e 


o 


c 


o o o c 


c 


o o o 






o f*- i/> o o 


o 


o 


c o o o 




o o o 






• ■ at* » ■ 


• 


• 


• • % • 


• 


• • • 










r- 


i-H ifi >c 


n 


o o 








n 


CM 




CM 


o*«* in 

































m » 














tj. 






QC* w 




















Lu' C 




cr 










U 1* u. 






>~ aj 














U. i/> « 






< in 














< K 






^ a c 














I- • C/) 






a o a 




a 










in 2 






a 




in UJ 










u. • 

cr o u o 
u: ^ < it 






cr o 
c 3 




X X 










J 2 O O 






a c c 










IT 




K CJ ti. <. C 






c a < 


•J 


o c 


•J 








a lA < c 1 u 




-J 


o en a ol 


< 


2 2 


< 








li. 1-4 bj c 2: 




< 


UJ Uj C 










lU 




X e o 






t3C 2* Ol X 


o 


CD 


o 


2 


c 




U < < 2 Z' 




c 


•I ^ C 


♦~ 


< tr 




Uj 






^ k-^ 


< 




a X ;r < 


X 


cr u< tr u< 


cr 


O 






L. C <: e C 






u. o u 




a a 




*"> 


in 




K »^ 2. 2 2 


O 




o «3 tr 3 




U; C -J 


in 




<u 




a c; — ^ c 




1/ 


C3r :^ : a 




o -1 e a 








i (/^. U X X 






c ^ u 




< < a X 


it. 


tr 


o 


Ll 






>- 


u e — > 








c cr 


•* 


w 


o o u» « <x 


(7. 




^ IX c^ 




a c >- tn 




W UJ 


^ Ck- 


a 


cr 2 u - > 






a ^ N N 








a 


O lu 




^ a 1- a 


u 




X U. ll. 


u 


> < a 






C C 


o 


ir c u 1 9 Ui 


Ll 




UJCJ c. 




<x Ci u.' 


u< 




o r 


tr 


<i < X 5^ r; a 


< 


o 


a <i > »- 




*r c X a 




H- in 




^' U- c> c z 






< c ^ 


c 






c o 


1^2. 


a. 


u a c i i: 1/- 




Ik 


K i IT. 


lAJ 


X *^ — c 







ERIC 



5/ 



irt 



ir 




T 








or <A 




o <r 


a 


C -J 


UJ (T 


at u 


2: X liJ 




u? u cr 




c: «3 




:d u. <J 




K K 2 


(/J 


to 


c 


tu c 




DC a 


li. o 


tlJ u. »- 


a: CJ 


a X 




bj 




a «i 


i/> cr c 


c'tt 


0 UJ 






<r o 




tr a 


u; <i 


2" a 


0 ^ 


UJ 


< 0 J 


a r» 


cr a 


5 z 


UJ Ct £ 




> 0 0 


u a 


< b. u 


< . 








c a: 




> 





















^ ^ o 2 



r* #Mi ^ 2 



o rvi 



o 2 



in 2 
^ cv 



^ — N 2 



r; 2 
>tf cv 



c\j cr 



^ ^ 2 

C\J CVi ' 



fv- 2 



w o 2 



»M ^* ^ 



CU (V IT «t nC ^ 
M tc ^ IT 
• o • • • • 

O fV) I*) 

n H-i CM ^ 



o (\/ IT e <f 

IV a OC O IT 
• «•••• 

h- c\j 



K cv IT r> >o ^ 

J5> CO i-^ IT 



' ff\ ^ o N o cc 

*t o tn rv •H 

• • • • • • • 



IV 



c cv c m 
^ «^ cv (V 



CO 



in cv ir> rj %o 
o CT^ cc 4',!*- :n 



IT (V c cv n 
ir fv 







N e ^ 


(V 




0 0 0 


• 


r 


• • • • 




0 




0 


n 




<-* 




J 






cc 0 <-H ^ 






0 0 0 


• 




• • • • 


n 






0 


(V 




«^ 






IT 


cr 


X 0 —1 >t 






0 0 i-i c 


• 


• 


» • • » 










0 





0 cv IT 0 ^ ^ 




0 


0* GC 0 in 




in 


^ • • * • # 






cv C CO 






1") ^ cv 






^ cv tn c -C 


X 




f*> 0» CD © #^ x 


n 


0 


•.•••«• 


# 




^,cv 0 






(V »*« rv 


m 




CO cv tr 0 «^ 'J 




•>« 


CO c^ DC 0 r» LT 


< 


a 




• 


• 


0^ rvj 0 rj 






nj 












cv tr ^ ^ ^ 






^ c> « X. tn 








• 


• 


*r cv 0 cv cr 




(V 


r» :v 




r* 








n cv in © ^ 






<r 0" CO c ^• m 




in 


• ••«•* 


• 


• 


(V cv 0 ro 




(V 


in »^ fv 




n 


^ .-vj ir- 0 •£» ^ 




n 


0 a cc 0 in 




in 


• ••••• 


« 


« 


'© cv c n 


CO 




(V 


rvj 


r> 




■-4 




04 cv c <r> 'J 


c^ 


IT 


0* x» 0 f*- in ■ 


n 


a; 


• V • • • « 


• 


• 


n cv c D 




cr. 


fn ^ Oj 






C CV Jt il> 




ri 


ri ff\ 3j ^7 P» If) 








• 


« 


> CV 0 rn r> 


0 




fw (V. 


n 


n 









on O r-4 ^ 
O O «-H o 
• • • • 



IV. 



(V 



fv» 



IT C cv ^ P-» 

• « • • • 



o en sc 
o & ^ <t 



m c 

cc c in 4" 



cv c o o 
^ o c o 



OC O f*> CT' 

r) o m ^ 



flD e ^ «t 

O C i-H o 



U) €5 ri r> 
•9 o ^ iV 



cv 



cv 



vr 00 o 
• • • • 



in c <-* 
(^ c oc o 
• • • • 



o n 

in o flc o 



o o •»« •■^ 

O O CO o 
• • • • 



O «^ »^ 

o o so o 

• • • • 



ON cc ^ — 

o n X' o 
« • • • « 



CT" n <-* «-! 

C O CO o 



^ ^ r—* 
O p-i OC C 
• • • • 



^ o *^ «^ 

o o cc o 



rv o »M 

o> c oc o 



^ M 

^ tf) c 
• • • « 



tr cr — «-H 
O o 



cc 


cv 




cv 






cv 












r* 


fO 








* 


(V 


vVI 










in 




CO 


CO 






cv 






CO 






cv 


CD 


00 




• 


* 








<v 






n 


CO 


CO 


CO 


• 


• 


cv 


CV 









CO 


cr 


CO 


• 


9 


CV 


0 










0 


CO 


c 




■ 


• 


CO 






in 






CO 


CV 


0? 


cc 


• 


• 


(V 






CV 




#~» 


<t 


OD 


N 




« 


• 


fV 


0 










r~ 


•a- 


0 






• 


cv 


CO 




cr 


0 


0 


•—1 


CV 


9 


• 


CO. 


c^ 











••»••• c^ * 

ir U* IT 2. 

a 

< >- z or 

•J K C2 

o o 
in V 



U. ' ■ 

a < 

2 u? - 

0.: 



c 



o 
o 

X 

u 
in 



Q 
C 



CC 

u. 

X 

<n <■ 

a 

c ^ »- 

~ C-i o 
Ct U.' 
K O O 

tr i/) u. 

2 Q. 

o in 

V or 
c/^ C u 
< < X 
^ Uj I- 

c; K c 



u 






cr • 










u. 






or hi 










« u. 






u 




-«n 






U. U- 






> uJ 










Ik tn < 






< ir "> 
















^ a c 










• l/; 






a 0 cz 




or 






(0 3. 






a 




C/> . Ui 






UJ • 






u • 




1- K 






OCJ u 






UJ Ui u: 

c n r 
a- c c 










< or 








■ ■ >: 5 ■ 






u <: C 


















c a < 




c c 

2 2* 


•J 




0 e cr 




.-J 


u tr..a a 




d 




^ 2 






u: u 0 






1- 




u c c 






a 2a s. 


c 


C 


C 




< X 2 




c 


V c 












< 




oc I a <. 




in u> in U) 










C 


u c ^ u 




a a 






2 2 r 


C 




c <i ir X 


tr 


UJ C ^ ' 


tr 




^ c 




4/ 


a 2 r 0 




c .J c a 




H- 


a X ^ 


a 




C »^ u; 




•a « a ' a 


iT 




0 U 1/ 


—1 


>- 


u 0 *- > 




u => 


•J ' 


C 


«Q ^ ^ 


(/# 


1- 


IJU ^ C 




a u >- en 






b' U ^ 








s 


Q 






K Q 






a u.' 


u 


•J > «a 0 


a 


^* 


f 1 u. 


.U 




■ u .t^ c 




< »- .1 Uf 


U: 


<t 


^ :i a 


■ 




a > 




in c X X 


f- 


h- 


OCX' 




< 


<i KuO ^ 


0 


^ 2 ^ H 


••l 


C 


2 2 4/ 


4n 








(£ -J C 


Z 





ERIC 



< 

a 

o H- 

a c/) 
a o 
o 

•.^ < 
c a. 
<3 e> 

It- o 

a: cc 
Cl 

OJ -ID 
H IT < 

a 

a. J 
o o 
o c 
I 
li. o 
c 

>- 



vO 



2. 
C 



H> L. a 

L. O 

>- «1 _J 

CC H- Ui 
(/> > 
»- Ui 

c 

o tr. 

u- o 

-I *I 
< 

D O 
Z 

2r »- 

< o 

a 



I- 

d: O 



tn 
-J c 
0- < o 
c z> 
o z 
-z 
a. <i 

<a 
X 

c • 

o 
or 
a 



fn r» o oc 
tvj ^ n c m CT 
• ••••• 

fvj in r> n 
^ <r ^ o* N 
(*> 00 cc o* 



o cr IT > c !^ 
%o h- sC o o 0^ 

o ro (V o ro -^t 
(V. ^ <Vi c\. a* 



< 

Q 
U.' 

a 
o 



o 
o 

• 

c 



CD 
O 



in 



CM 



(\J 
cr 



ec 



^ h- o o 


(VI 




CW M c c <\« 


in 




• ••••• 


« 


• 


CT o in o 


in 


a 


r-» CL rvj 




(\. 


n cw CP r- 




rH 




in 





CO h- ^ o o ^ 

r) v£? o c o 



M ^ 

oj <\J 

CC ^ 

o <r oc. 



IJLi U • 

DC <J K 

I CO 

I iaJ 

I a > 

I -1 z 

I o 
I 



I o -J 

I z 

I *- 1- 

I o o 

>- <1 r- 



CJ* o »— 
I X c 
I o 
I en 
I 



•5- *0 "d- fU OJ 
• ••••• 

«c o ^ ^ . o 



o o o o oc r- 
o o o o t*> 
• ••••• 

CV GD O C «C (VJ 
CC IT O tV (T (VJ 

in vc *c r*- n c 
IT in cv 



c o c c X r** 
o o c c ri -« 
• ••••• 

OJ rc c- O (VI 

X IT o rvi a> (VI 
tr ro o 

IT IP (V xC 



o o o o o o 
o c c o o o 



«w o o ru c o 
^ o c O ^ 



C O O (VI o o 
O O O 1/1 O 



^a* (VI ^ (V; f 



c o o o o 
o o o o o 



o o o o o 

O O C C9 O 



o r*- c c o 
e c c o 



e 
o 





in 


<M^ o in CC 


0^ 






IT. C >C oc 


(V 


• 


• 


• • • • • 


• 






o <r n 








>c 00 >}- m o 






en 


^ (VI >t 












(V 












c in c\j •-•1^ 




• 


• 


• • * • • 


• 


c^ 






(VI 










in 


00 


CMT O in OL 




in 




^ h» O \0 QC 




• 


• 


• • • • • 


• 


oc 






(VJ 




cc 


^' ^ IT C 








n ^ 


n 


o 








•? 









(VI 

cu 



o 
(U 



o 
o 



o o o o o 
o o o o o 



<V1 ^ xO CO c» 
(V 



o c o o 

c o o c? 



o o o o 
o o o o 



IT m o o 
(VJ cr o o 

• » • • 

(VJ o 

(7» r> 

(VI 



(^ CO o 
(V ^s- 



o in 
n fo CO >c 
*c n 



in 


CO 


^ if : O »c 




in 


oc 


< (^ 




• 


• 


• • • • • 


• 




(U 


o xc (\. r** r** 






<r 


o* ir. (VJ o 


cr 






(V ^ fVI 


r» 


c» 


cv 






-a- 








o 


in 


e- (T r; *c 


in 


o 




fO c*) c o •i' 






» 


• • • • • 






in 


o o m (\i 


o 






o (v a X 


a 




fO 


CO o cg r-« ro 






0* 




n 




o 








^ 










o o o in in 


o 






in e in 


m 


• 


• 


• • • » • 


• 






<^ ^ ^ »c 


n 











o 
o 



<r 

•4- 







o 




o 






(VJ ^ 


• 


• 


m 


• • 






(*) 


O (Vj • 




h- 


r» 


r- (VI 


























o 


o 


o 


cvi cr 








cr cr • . 


• 




• 


• « 














c^ 


(Vl 




<Vf 


?VI 


o 










c 


o 


o 




(V 








• 


• 


• 


• • 




en 






(V 






m ^ 


(n 

















in 



^ in 



n 

"4- ■ 



o r> o v£j 
• • • • 

in (VJ 



n o -a- 
^ f*- r»- ST 

4 • • i> 

(VJ cr r*" ^ 

fV.« \C X \D 

cr n 



C O C <9 

c ^ c ^ 

• • • 

c cr- o 
o f*- »o 
(V in D 



c o o o 

O (VJ o o 
• « • • 

xX) <nin 
cr o rv 
o 

(\j in 



coo 
coo 

• • • 

o o c 

0*3-0 
^ (VI U1 
(V 



O o c:* 
o o o 

• • • 

o c o 
o 4- o 
<f (V in 



o 

cr 

CVi 



o 



xc n 
%c in 



^ (T cn- 
c^ in 

(Vi o 





(VI 


fVJ 


o 


• 


• 


* 


* 
















o 








•** 


IT 


o 


o 


in 




o 


o 


1*- o 


• 


• 


• 


• • 




xO 




(VJ 




n 












o 








cr 








in 




c 


c 


€0 in 


o 


o 


c 


in en 


• 


• 


• • 


• • 






xC 


CVJ ^ 


o 


n 


n 


in a 


(VJ 


r»- 


r»- 


in 


OJ 
















o 


o 


c 


o tn 


cu 


o 


o 


n CO 


• 


• 


• 


• • 








o o 


(VJ 














(VI 


00 


























o 


o 






o 


o 






• 


• 








xD 






n 


CO 




t 


r»- 


r»- 






c 


o 






o 


o 






*• 


• 






■ sD 


xC 






n 


n 






: r* 







O 

in 



in 
z 



o UJ 
c a: 

X 2 

in z 



D 

C- 

a 



lU 
X 

(J 

U U. 

2 < 
C 

O tt. 

a u- 
v X 
(T CJ 
«: <i 
^u. 



u. 



ti. IT < 
• U) 

tn 2 

U' • 

o c- CJ 
a o o 

H U < C 
l/ C I c 
»— <I 2" 

-J c o 
< «i Z 2.' 



cn 
cr 



Q. i- C 

U X 2 *- 

c; i-^ IT 

C «a < 

i - li. U. > 

H- K O 

C I I u.- 

< ?: 2 a 

ti- C C 2, 

a 2 2 4/^. 



a 

u. 
li. 

I— 

in 



tn 
o or 
iju u; 
tn n 
r c < 
c a .1 
a a 

~? a. 
o c *i 
a 

a a 

c c 
a V u. 
— c c 

<■ 

I- u_ > 
: a z 

i-. c 

^ ^ 

u. c u. * 

tj li. > 

c u. 

> 



tr. 



c 
or 
c 

u tr. 

\Xf XL.' 

a z 

or X 

c < 
Q 
c 

u c- 
u. ^ 
D 

X 
U. O 
X 43 

«a U; c ^ u- 
H »~ i 1/ K 





in 


UJ 




. cr 




»— 


I— 










« 














Z 

u.- 




ir 


* c 




c 


4. 






< 




I— 




« 






C 


c 




C 




h- 


<. 


1/ 




I— 


CC 


in Cl. 


IT. U' 


a 


«a 




n a 








xfi 




e ^ 


in 


iZ 






c a 




a 




s> < 


e. Q 


in 




z 






•J 


UJ 


UJ 


a. >- 1/ 










Q 




a 


u 




Q 


Ur 






< r-. 


0 li.> 


b. 


c 




tr. r 


X I 




in 


c 


< 


»— 


4 


u. 




ic 


^ c 


X 


a 



CJ> 
»— 

X 

en 

in 
a 

U' 

»— 

z 
u. 
u 

»- 

o 

h- 

a 
I- 



U^ 



tn 

in 

c cr 

O Lu 

a 

•I 

«i >- 
h- in 

c c 



5 3 







z 










%f% 


o < 




O J 


1- UJ CT 


a u 




a 


w u a 


>- 


c < 


c 3r 


< 


'Z 


1- 2 




(/> ^ 


o»- 


u. C 


< <r 


o: q: »— 


c 


UJ 


a o 


a X 


> 5 


1- :^ 


a <? 


(T tr cr 


C or 


C Ll j 


K 'J 


u 0^ c 


C 




tr a. 


U- < 
-J u. 


2 a 




*l O 




X a. 




u. a r 


o 


> c o 


c; c 


< u o 






u. u.* 




o ar 




>- 




o 












U1 







ec o ftj a- ce 




tr 


cv« o nO f** nj 






n 






cr 


nO CI 


^ c ^ r** 




X 


^ O fO ^* 


in 


m o f) f** 














• 


• 


• • • « • 


• 


• • « • 


• 


• 


• 


• 
















CO 














cv 














cr 


^ ^ O 2 


O C W X X 






X o ro ^ 




cv o in *-< 


TC 








HJ ^ 












fO C fO 














• 


* 




• 


• • • • 


• 


• 


• 






IT IT* *^ 










































Ci ^ O 3^ 


^ cr w (v X »c 








X 


C O IT ^ 










(VJ 


< X O ^ f- 


CV 




« o ^^ o © 




cn o n r*- 


IT 


<t 




o 




• ••••• 


• 


• 


• • • • • 


• 


• • • • 


• 


ft 


• 


« 








X 






















IT 




















■-4 
















CM 


fvl ^ C7* rf' 


% IV w vV> 3^ ^ 


X 


CL 


IT* c n (a 




n o ^ 












«^ C ^ N GC 






O C C IT 




< vc 


o 










O 


in 




• 










»-< 








i\i 


















»«4 • 


O (V' X C: 


<r 




tn e vc '-^ IT 




(V ^ in 


a> 


>o 


%c 


in 




(\ G <)■ (*< 






Cu W ^ W u * 


tn 














fV.* ^ ^ C 


LP 


ft 






cv 








0^ 




n «-* 


















CC 


^ ^ 00 


X "X* o (V i* 3r 




<v 


f*^ f*) o 




com 


«n 










ec CC C ^ N 




cr- 


ac o r> o 


X 


LT c: r? r- 


IT 






tn 






o 


CD 




IV 




h- 


*** 








ri cv; 


in 


in 














(VI 






















(Vl 


f*/ 3" 2 


<f o ry t: cc 




o 


C OJ 


m 


i o m 


cv 


>£> 




(VI 




IT c ^ 




IT 


r- O O O LT 




0 - c r; 


c 










J"? in o» 










in <v 


r> 












r- 


»— • 














o 
























f\J <-» *C 2 


^ o c: *v X cc 


tVi 




O vD f\l iT' 


o 


in o If 1 »^ 








(VJ 


tVj cv 


»^ O O ^ f** N> 




a* 


C C* O P** 




*c 








X 








X , 


► r-i 




vo cv 


o 


»«-» 




%o 




in 




cv 














o 


»-i ^ 


, O l\J O; 


u» 




cr o in ivf X! 




O If) •'^ 


. ri 


nO 




U) 




t-< IV ^ r- c»j 






n o IV »** MJ 


ri 


<r ri 








IV 
♦ 




LTV X- ^ M 








n 


^ cv 














a- 



















n 



•I 

o 
c 

X 

u 
en 







u. 








tr • 








•» c 












a t- 








V u tr 




< 


u. 






li. o 


a- 




<r 


1/ a. 






u. 






>- •■ u> 








<r >• 2 a 




U. iT 


<: 






« tn 






4 


-J H- u.- c 






h. 






-J ar c 


< 












in 






a c a 






cx 














*- a 


CL 




<n tii 






tiJ 


• 












1- »- 


cn 


















»-i 4 


w 




. *- < 


0. 






c > 


a 




X 






2. U 


o 






csr O O 


< 






c 












C a 4 






c c 

2 2 


a: 




tr. e 1 


s 




•J 


u tn a a 






a. c 




a 2 








lu u; c 


c 


I* 


^ <f 






C -JO c 


Q 






;y 2 a N. 


u: 


o 


O 


X < 




H- « 4 2 


2 




c 


N. O 


c 


\- 


« 1/ 


2. in 




O — 


< 


< 




'ir X ir 4 




X 


CO u; tr {jj 


r *: 




r u tj IT C' 






t* 


U. C" U; 






a 0 






a O 2 2 


2 


o 




o < <n X 




in 




a 




H- *— CL ^ 


C 






a r/x a 






-J c a 






I/. < UJ X 2. 


»M 


X 




c -?u 


o 




< 4 X .t2 


c- 




2 CI 


*n 






o c > 




■ 2'- 


Ui X> X' 


o 




tx. C o <1 




v- 




u. w o 


I/; 




tt ti >" tn 






U ^. b Ll 








a s 






0 






to J ^ K 


(^ 


u 








o 


— > 4 cr 




c 


1/ C/ C 1 1 




u 




u c 






< a u- 




tr. 


o < « 2 2 


a 


4 


u 


a < > 






<n c ff X 




Ir* 


^ Ui u.> c c 






< U C 


iT 


c 


4 2 *-* H- 




a 


O H- Ct 2 Z* 


in 






1- 1- a in 






a i-H^ o 



a: ■ fr* 



2 
UJ- 

u 
o 



4 

• cn 

c ui a* 

K I- u. 

X 4 

X ^ 2 

tn lu iij 

«/ u; , #- 

4 «J O 

cr »— I 

or 3 a 

U' O I- 

K to to 

4 Ui 



tn 
o 
o 



■4 
O 



3V. 



